3 |
sj-pdf-1-ltj-10.1177_02655322211032873 – Supplemental material for Aptis test review ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
sj-pdf-1-ltj-10.1177_02655322211032873 – Supplemental material for Aptis test review ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
Facilitating Willingness to Communicate (WTC): Communication for Academic and Social Life (CASL)
|
|
|
|
In: Theses and Dissertations Available from ProQuest (2017)
|
|
BASE
|
|
Show details
|
|
7 |
Objectives, Goals, and Formative Assessment in the Oral English Proficiency Program
|
|
|
|
In: Theses and Dissertations Available from ProQuest (2017)
|
|
BASE
|
|
Show details
|
|
8 |
Measuring fluency: Temporal variables and pausing patterns in L2 English speech
|
|
|
|
In: Theses and Dissertations Available from ProQuest (2016)
|
|
BASE
|
|
Show details
|
|
9 |
Developing L2 reading fluency: Implementation of an assisted repeated reading program with adult ESL learners
|
|
|
|
In: Theses and Dissertations Available from ProQuest (2016)
|
|
BASE
|
|
Show details
|
|
10 |
Second language writing instructor written feedback practices in an ESL freshman composition class: A complexity theory perspective
|
|
|
|
In: Theses and Dissertations Available from ProQuest (2015)
|
|
BASE
|
|
Show details
|
|
11 |
The processing of formulaic language on elicited imitation tasks by second language speakers
|
|
|
|
In: Theses and Dissertations Available from ProQuest (2015)
|
|
BASE
|
|
Show details
|
|
12 |
Making the cut: Indiana school accountability and English learner test performance
|
|
|
|
In: Theses and Dissertations Available from ProQuest (2014)
|
|
BASE
|
|
Show details
|
|
13 |
Effects of pragmatic task features, English proficiency, and learning setting on Chinese ESL/EFL spoken performance of requests
|
|
|
|
In: Theses and Dissertations Available from ProQuest (2014)
|
|
BASE
|
|
Show details
|
|
14 |
Relationships between lexical proficiency and L2 oral proficiency
|
|
|
|
In: Theses and Dissertations Available from ProQuest (2014)
|
|
BASE
|
|
Show details
|
|
15 |
Disentangling fluency, comprehensibility and coherence: Toward a better understanding of oral proficiency profiles
|
|
|
|
In: Theses and Dissertations Available from ProQuest (2014)
|
|
BASE
|
|
Show details
|
|
16 |
Accountability Lessons for Indiana Schools Serving English Learners
|
|
|
|
In: INTESOL Journal; Vol. 11 No. 1 (2014) ; 2373-8936 (2014)
|
|
BASE
|
|
Show details
|
|
17 |
Development and implementation of an ESL classroom assessment of face-to-face conversational interaction
|
|
|
|
In: Theses and Dissertations Available from ProQuest (2012)
|
|
BASE
|
|
Show details
|
|
20 |
A many-facet Rasch analysis of rater effects on an Oral English Proficiency Test
|
|
|
|
In: Theses and Dissertations Available from ProQuest (2010)
|
|
Abstract:
This study investigates the impact of rater severity and the stability of rater severity over time on the scores examinees receive on an Oral English Proficiency Test used to certify International Teaching Assistants at a North American university. Ratings from 434 examinees by 9 raters from August 2007 testing administration and 10 raters from August 2008 testing administration were analyzed using FACETS, a multi-faceted Rasch analysis program (Linacre, 2008). The study found that the raters demonstrated different levels of severity. However, the impact of rater severity on the test scores was small. About 4% of examinees from the two testing administrations tested out with observed averages higher than their fair averages. The majority of raters used the scale in a consistent fashion. One rater, however, demonstrated inconsistency with slightly larger infit statistic than the upper control limit of 1.2. The level of severity for most raters was not invariant but acceptable across the two sessions a year apart. Two raters showed drift of severity more than the Rasch model expects. New raters do not show more variation with respect to their severity and stability of severity than experienced raters. Slightly larger gaps between adjacent rating categories were identified, which invites the opportunity for scale revision that would allow raters to better distinguish the oral proficiency levels of the examinees. The study shows that FACETS is a useful tool for studying rater performance. The FACETS results can be used to target individual raters in follow-up rater trainings to help improve rater accuracy. In this way, examinees as stakeholders are protected against errors introduced by human raters.
|
|
Keyword:
Educational tests & measurements|Linguistics
|
|
URL: https://docs.lib.purdue.edu/dissertations/AAI3413993
|
|
BASE
|
|
Hide details
|
|
|
|